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This listing of claims will replace all prior versions, and listings, of claims 
in the application: 

Listing of Claims 



Claim 1 (Canceled) 



>J^Claim/2f^ (P 
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^\J^^Claim/^ (Previously presented): A^ethod comprising: 

^ initiating a search for images /based on at least one query keyword in a 
query; 

identifying, during the ^arch, first images having associated keywords that 
match the query keywona and second images that contain low-level features 
similar to those of the grst images; and 

ranking the ^ist and second images. 

Claim (Previously presented): A method as recited in claim X further 
comprising presenting the first and second images. 



PAGE 4135 * RCVD AT 2/2712004 3:10:17 PM [Eastern Standard Time] ' SVR:USPTO>EFXRF-IH ' DNIS:8729306 * CSID:509 323 8979* DURATION {inm4S):09-20 



FEB 27 2004 12:20 FR LEE - HRYES PLL 509 323 8979 TO 17038725306 P. 05/35 



^^/u Claim>*^^reviously presented): A method comprising: 

/ initiating a search for images b^ed on at least one query keyword in a 
query; 

identifying, during the search, first iniages having associated keywords that 
match the query keyword and secpnd images that contain low-level features 
similar to those of the first images; 

presenting the first and second images to a user; and 

monitoring feedback from/ the user as to which of the first and second 
images are relevant to the query. 
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Claim-S^reviously presented): A method comprising: 
initiating a search fo^ images based on at least one query keyword in a 

query; 

identifying, during tfie search, first images having associated keywords that 
match the query keywom and second images that contain low-level features 
similar to those of the first images; 

presenting the firgt and second images to a user; 

receiving feedback from the user as to whether the first and second images 
are relevant to the query; and 

leaming how the first and second images are identified based on the 
feedback from the user. 
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Claim ;^ (Previously presented): A method as recited in claim^, wherein 
the monitoring comprises 

presenting the first and second images to a user; 

receiving feedback from the user as to whether the first and second images 
are relevant to the query further comprising: 

refining the search to identify additionial images that contain low-level 
features similar to those of the images indicated by the user as being relevant to the 
query. 

{£>■ I 
Claim-T^tlPreviously presented): A method as recited in claim a wherein 

the monitoring comprises 

presenting the first and second images to a xjser; 

receiving feedback from flie user as to whether the first and second images 
are relevant to the query further comprising: 

assigning a large weight to an association between the query keyword and 
the images deemed relevant by the user» 

Claim/S (Original): A method as recited in claim further comprising 
grouping the low-level features of the images deemed relevant by the user. 
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Claim^(Previously presented): A method as recited in claim^ wherein 
the monitoring comprises 

presenting the first and second images to a user; 

receiving feedback from the user as to whether the first and second images 
are relevant to the query further comprising; 

assigning a small weight to an association between the query keyword and 
the example image. 

Claim /IcrtOriginal): A method as recited in claim ^further comprising 
identifying additional images with low-level features similar to those of the 
example image. 

Claim +f^(Previously presented): A coniputer readable medium having 

computer-executable instructions that, when executed on a processor, perform the 

\ 

method as recited in claim -2^ 

j^^^Clamvl2^0riginal): A method comprising: 
' permitting entry of both keywcfni-based queries and content-based queries; 
finding images using hop. semantic-based image retrieval and low-level 
feature-bas^ image retrieva 

presenting the irn^es to a user so that the user can indicate whether the 
images are relevant!^d 

conducting semantic-based relevance feedback and low-level feature-based 
relevance feedback in an integrated fashion. 



MSftJS46I8.t C:}A4SJ'(A604u3'MSJ.604t;SM03.dpe 
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Claim J3^0riginal): A method as recited in claim j^, fiirther comprising 

ranking the images- 
Claim -l<tOriginal): A method as recited in claim J^, further comprising 

using images indicated as being relevant to find additional images. 

Claim lo (Original): A computer readable medium having computer- 
executable instructions that, when executed on a processor, perform the method as 
recited in claim 12t 

Claims 16-19 (Canceled) 

15' 

Vj/^^Claim-2(r( A metho^comprising: 

/ presenting a result set of images that are returned from an image retrieval 
search of a query having at least oner keyword; 

monitoring feedback from Jk user as to whether the images in the result set 
are relevant to the query; 

in an event that the use^ selects at least one image as being relevant to the 
query, associating the keywoird in the query with the selected image to forai a first 
keyword-image associationyand assigning a conqaaratively large weight to the first 
keyword-image association; and 

in an event that me user identifies an example image for refinement of the 
search, associating ther keyword in the query with the example image to form a 
second keyword-image association and assigning a comparatively small weight to 
the second keywor(>image association. 
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Claim/2l" (Original): A method as recited in claim 2€fr further comprising 
conducting both content-based image retrieval and semantic-based image retrieval. 



Claim 22 (Original): A method as recited in claimx20, further conjprising 
presenting the result set of images in a user interface, the user, interface facilitating 
the user feedback by allowing the user to indicate which images are more relevant 
and which images are less relevant 

Claim ^ (Original): A computer readable medium having computer- 
executable instructions that, when executed on a processor, perform the method as 
recited in claim af^. 



Claim 24 (Previously presented): A method cpmprising: 

computing, for each categoryy a repres^lmtive feature vectors of a set of 
existing images within the category; 

detenmining a set o£^pT^n^tiveS[ceyword5 that are associated with the 
existing images in each category;. 

comparing, for each n^ ima^e, the low-level feature vectors of the new 
image to the representative feature vectors of the existing images in each category 
to identify a closest mOT;jhing category; and 

labeling the new image with the set of representative keywords associated 
with the closed matching category, 
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Claim 25 (Previously presented); A me^iod^ recited in claim 24, further 



comprising using userTeedba^4o^ectively add and/or remove keywords from 
the new imagg. 



Claim 26 (Original): A method as recited in cjaim 24, further comprising: 
placing the labeled new images into a holing categor}^, 
evaluating the labeled n^wuhages^ ]the holding category to determine if 
any of the keywords assooiatefkwijh/me labeled new image match the 
representative keywords fronKMclj/cCtegoiy; and 

assigning the labeled new image to the category that best matches the 
keywords associate with the labeled new image. 

Claim 27 (Canceled) 

C^^^ Claim 28 (Previously presented): An^age retrieval system comprising: 

/ a query handler to handle both keyword-based queries having one or more 
search keywords and content-based qi^ries having one or more low-level features 
of an image; and 

a feature and semantic nfatcher to identify at least one of (1) first images 
having keywords that match the search keywords from a keyword-based query, and 
(2) second images having/low-level features similar to the low-level features of a 
content-based query, wlierein the feature and semantic matcher ranks the images. 

,0 



Claim 



(Previ 



viously presented): An image retrieval system as recited in 



claim ^^(^f wherein the query handler comprises a natural language parser. 
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^ Claim ^ (Previously presented): An image retrieval system as recited in 
claim ^ wherein the query handler comprises: 
a parser to parse text-based queries; and 
a concept hierarchy to define various categories of images. 



Claim^J^Previously presented): An image retrieval system as recited in 



claim further comprising a user interface to present the images identified by the 
feature and semantic matcher, 

^.^^^j^Claim 32 (Previously presented): An image rej^eval system comprising: 

X a query handler to handle both keyword-b^ed queries having one or more 
search keywords and content-based queries h^ng one or more low-level features 
of an image; 

a feature and semantic matchei/to identify at least one of (1) first images 
having keywords that match the se^h keywords from a keyword-based query, and 
(2) second images having low-Jevel features similar to the low-level features of a 
content-based query; 

a user interface to liresent the images identified by the feature and semantic 
matcher to a user, ihp xiser interface allowing the user to indicate whether the 
images are relevantxo the quer>^ and 

a feedback analyzer to train the image retrieval system based on user 
feedback as to relevancy. 



PA(S11/3S'RCVDAT2/27I20I)4 3:10:17 PM [Eastern Standard Tiine]*SVR:USPT(){FXR^^^^^ 



^9 



FEB 27 2084 12:21 FR LEE - HfiYES PLL 509 323 8979 TO 170387^06 



P. 12/35 




I 
2 
3 
4 
5 
6 
7 
8 
9 
10 

n 

12 
13 
14 
15 
16 
17 
18 
19 

20 

21 

22 

23 

24 

25 



Claim }S (Previously presented): An image retrieval system as recited 



m 



claim 28f further comprising: 

a user interface to present the images identified by the feature and semantic 
matcher to a user, the user interface allowing the user to identify an example 
image; and 

the feature and semantic matcher being configured to identify additional 
images that contain low-level features similar to those of the example image. 



clainl<2'Sffurtfaer comprising: 

a user interface to present the images identified by the feature and semantic 
matcher to a user, the ixser interface allowing the user to identify which images are 
relevant to a particular search query; and 

a feedback analyzer to assign a large weight to an association between the 
search keywords and the images identified as relevant by the user. 

Claim 3i^(Original): An image retrieval system as recited in claim 
wherein the feedback analyzer groups the low-level features of the images 
identified as relevant by the user. 
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Claim ^^(Previously presented): An image retrieval system as recited 
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Claim 36 (Previously presented): An imag^etrieval system as recited in 
claim 28» further comprising: 

a user interface to prese^fmesjma;^ identified by the feature and semantic 
matcher to a user, the user interfac.e^^>^ymg the user to identify an example image 
as being less relevant or irrelpV^t to ^e query; and 

a feedback anal^^r to assign a small weight to an association between the 
search keywords at^dime example image. 

Claim ^ (Original): An image retrieval system as recited in claim 36, 
wherein the feature and semantic matcher identifies additional images with low- 
level features similar to those of the example im^e. 

l^CMm 38 (Canceled) 

t,^^^ Claim 39 (Previously presented]^ A computer-readable medium having 
computer-executable instructions that^when executed, directe a computer to; 

find images using bot^emantic-based image retrieval and low-level 
feature-based image retriev^ 

present the imaged to a user so that the user can indicate whether the images 
are relevant; and 

concurrent conduct semantic-based relevance feedback and low-level 
feature-based/relevance feedback. 
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Claim -4© (original): A program as recited in claim further comprising 
computer-executable instructions that, when executed, direct a computer to rank 
the images. 

Claim Ai: (Original): An information retrieval program, embodied on the 
computer-readable medium, comprising the computer-executable instructions of 
claim 3^* 

Claim -42^ (Previoxisly presented); A computer readable medium having 

computer-executable instructions that, when executed on a processor, perform the 

3 

method as recited in claim4r 
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